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ABSTRACT 


The problem of optimally allocating available efforts to search 
for an object at sea comprises a major class of problems in naval 
warfare. This thesis presents in some detail Koopman's classic two- 
region and continuous search models, along with the n-region discrete 
model which provides some continuity between the two. Brief summaries 
of four of the more important extensions to the basic theory are also 


included. 
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I. INTRODUCTION 


| A major class of problems in naval warfare consists of those 
involving the search for an object at sea, the position of which is 
unknown but is distributed in accordance with a known law of 
probability. The question of interest to this thesis is how to 
allocate available resources (or effort) in a search of this type, 
as for an enemy submarine or a downed pilot. 

Early research was done by B. 0. Koopman who, in 1946, wrote 

up the results of studies performed by what would later be known as 
the Operations Evaluation Group (OEG) of the United States Navy [5]. 
His models continue to be the basis for fur<her studies into search 
theory, and it is, therefore, natural to begin any paper on allocation 


of searching effort with a derivation of Koopman's original model. 
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II. KOOPMAN'S TWO-REGION MODEL 


Koopman began the study of search effort distribution with the 
miipiest case: consider two areas in either one of which an object 
may be located with a certain probability. The initial assumption 
to be made in this situation is that the random search model wil] 
be used to describe the search, regardless of the actu2] searching 
pattern used. This is a conservative yet realistic assumption since, 
practically speaking, any search, regardless how systematic, has a 
certain amount of randomness inherent in it due to navigational and 
other errors. The results obtained using this model are fairly 
simple and require no further assumptions concerning the particular 
detection law except for the observer's sweep width. 

A review of the developricnt of the random search model is an 


essential basis for a full understanding of Koopman's development. 


A. DEVELOPMENT OF THE RANDOM SEARCH MODEL 

It is assumed that the stationary target is equally as likely 
to be in any one location within the given search region of area A 
as in any other (i.e., the target is uniformly distributed in A). 
It is assumed, further, that the searcher has no set plan for 
observation. 

Several definitions are necessary at this point: 

P(X). . . the lateral ranae for a certain observer and target in 
the existing environmental conditiens. It is a graph- 
ical representation of the cumulative probability of 
detecting a single target passing at some lateral range, 
X, from a particular detection device under given 
environmental conditions. 


Ee 5: 3 the path leng:h of the observer in A, which is divided 
into N equal segments each approximating a straight line. 








L/N. . . the length of each of the N path segments. By the 
random search assumption, each is independent. 


1 We... the sweep width of the observer, equal to the area 
Rem 
under the lateral range curve. ( f Pin) 
~ mm 


Rm. . . the maximum lateral range from the observer at which 
the target is detectable. 


Let: event A be the event that the target is in area A, 
event B be the event that the target is detectable 
along any segment L/N (i.e., that it lies within the 
area L/Nx2Rm) 
event C be the event that the target is detected 
along the segment L/N. Then C is the event that it 
is not detected along L/N. 


event_D be the event that the target is detected. 
Then D is the event of non-detection. 


It is to be understood that event A is a condition throughout 


the following: 





2R,, ° % 
is. 
P(cis)= ELPia] = Ike "Pe a as 
AR m 
Thus, 
ple) = P(cre) P(e) = SE 
Pic)= I- Fa 
And, N Nam (1- Be 


Pipy=(i-se) =e 


When (=%) is small, which is most often the case: 


_ Wh ~ Wb 
Jn \) ya) ~ A 








So, 


4(-7) 
| PCO) ee 
and finally, 
~We 
PiplAy= J-e [Equation 1] 


At this point, the condition on event A has been inserted for 
a reason which will soon be evident. 

One final assumption which should be noted is that 2Rm<<L/N, 
thus permitting the overlap of segments to be disregarded . 


WL 
The exzression A is called the coverage factor, and measures 


the amount of effort expended in searching the area A. 

It should be noted that by the very nature of the observer's 
random path selection, the probability of detecting a target within 
a certain area, A, given that it is in area A, will approach, but 
never quite equal, one. In other words, the observer can never be 
certain of entirely covering A with the 2Rm-wide swath of coverage 
he is cutting out along his search path L, due to the possibility 


of crossing an area already searched. 


B. DERIVATION OF THE TWO-REGION MODEL 
In Koopman's simplest model it is known that: 


(1) A target is located within one of two regions of areas 
A, and Ao with probabilities Py and Po respectively, 


where: Py a Po = 1, p,70, py>0. 


(2) The target is stationary, which implies p, and p, are 
cons tant. 








| 
! 
} 


(3) The target has a uniform distribution in whichever 
region it is located. 


(4) L, which is the observer's total path or track length 
1S such that: L=L, tLos where L, and L, are the track 


lengths in A, and Ay 


A good measure of effort available is the length of track along 


which the observer can search. Since a maximum L exists and is 


known, the problem to which this model should provide an answer can 


be stated as: What is the best, or optimal, distribution of L 


be tween A, and Ao such that the chance of detecting the target is 


as large as possible? 


Using the events A and D defined previously, it is a fact that: 
Pip) = PCA) - P(dtA) 


In the two region model: 


Py 
Po = P(target is in A,) 


P(target is in A,) 


and the random search equation becomes: 
w Wh, 
RiGiA,) =o e ae 
~Wha 
P(olaA,y =1- ec ™ 


Thus, the mathematical statement of the problem is as follows: 
hk 
maximize P(D) = - Pi li-e “Ya ) + Pa (\-e » ) 


subject to: \_| +L, =\_ 


The objective function may be simoli fied: 


~ WL, ~Wwl, 

AY , Aa 

PCD) = pi- pie ees ~ fac ; 
= pr Pa - Pe re pe “AL 








Thus 
—~ WL, —-wh, 
| Ap. ° 
7 Gb) in oer pic shee Pac [Equation 2] 


Letting Lj=x and Lo=L-Lj=L-x, for simplicity, the maximization 
of [Equation 2] can be converted to an equivalent minimization 


problem, namely: —Wx ~W(L-*) 


UU ae F(x) = erence + PC iE 


subject to: O<sxek 

This problem may be solved both graphically and analytically, 
the latter of which will be followed in this thesis, though using 
a method somewhat different from Koopman's, since graphs soon become 
useless when the model is extended beyond two regions. Koopman's 
graphical solution is useful, however, as an aid to understanding 
just what needs to be done in optimizing the allocation of search 
track as a measure of searching effort in this simple case, and may 
be found in reference [5]. 

In order to solve this minimization problem using the Lagrangian 
approach, the inequality constraint must first be gotten rid of. 
This can be accomplished by letting xeue and adding a slack variable, 


so that the problem becomes: 


— Wu* —W (1-4) 
oe 2 A Aj. 
minimize 4 (u De Pc ‘+ Pre Ma 
U. 
subject to: un 4s aL 


The Lagrangian function is: 


i (a, us) = $(u) + A(L-a*-s*) 
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For which the following necessary conditions must hold at a 


Stationary point: 
| 
| 


ou x % 
(1) le = oe el 


Gye aoe 2uf (uy) -24ar 
sn (ft) 1 


From (2), if s#0, then dA=0, and from (3), uf'(u2)=0. This in 
turn implies that either u=0 (x=0), or f'(u-)=f" (x)=0. 

Again from (2), it might be that s=0. Then from (1), u-=x=L. 

Hence, there «are three cases to be examined: 


x=L>f'(x=L) <0 
c) x3 f'(x)=0 


Minimum at bs x¥=0 >f'(x=0)29 
( 
These cases may be visualized most readily be referring to 
Koopman's graphical approach in [5]. 


~w (L-%) 
Since, £(x) = pe axe + as Ax 


? 


— 
it 9 eet vi pe ™ yw Pre ‘i is obTained . 


Case (a): if 3a minimum at x=0 >f'(0)20 (the curve depicting 
f(x) can slope upward or be level for any x ¢[0, L] as x goes from 


0 to L). 





a -W-0 =W (L-°) 
Now, floj=- 5 pe ft = fre Aa 
] 2, 
-Wh 
=-\ >, h, tae Ax 2 O 








or, WE 
Nt Aa > AW 
ete 
Thus, we 
Po. AL > , ° 
AL Se z= a | [Equation 3] 
a 


Case (b): if 4 a minimum at x=L>f'(L)<0. 


By a similar exercise: 


a Soe P 
\ ‘ 
a e > a [Equation 4] 
| a 
Case (c): if Ja minimum at x 9 f'(x)=0, this value of x must 
be found. 
let Ry -W> W — Wil-) 
£'(x) = Sa P,e Ar +h, Pe Ad = "© 
In this equation 
—WL-%) —s fe 
oe 
By transposing, 
—Wwi Wx W - Wx 
W pa e Aa -eC AL = = oy 
Aa 
ii we -~wW — Wa 
Pu e A, ary e Y Ge = 
A, , 
Note that, A,tAy 
Pee ewe(kek)  -wa are 
e -'-e =e = 








Taking the natural log of both sides, 


Pa Wi we Bie \ 
Ln -K- +R. Ln + Wr ( A.A, 





] 
Multiplying both sides by W and transposing yields: 


AYA, | | 
x| =? A, y WJ A OW A; 





In this equation, 


a [af -s] =tle BR) 


Therefore, in the case where f'(x)=0, the minimum value of 


puis 2 9 pee AS 
xa (ae \(E oto Pa | 


hex) is at: 


or, 


A, AA, Pi A 
US jie te nog Pa A [Equation 5] 


It is obvious from the above equations that there exists one 
point, x, in the interval [0, L] which minimizes f(x) and in turn 
maximizes P(D) subject to the constraints on track (25th. 

Perhaps more irjportant, however, note that [Equation 3] and 
[Equation 4] set down threshold values for cs and = » Which, 
following Koopman's example, will be defined as the probability 
densities for the two regions, and labeled e, ande@,, eS Pe COUN an 
These values, then, are such that unless Q, exceeds the value ec Ls 
all searching effort should be concentrated in Ay and likewise, 


\. 


if es ee, A, should be ignored and all effort sent to A). 
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At this point, a final simplification of notation is necessary 
in order to clarify the preceding argument. Note that a better 
measure of searching effort than merely the observer's track length, 
L,,in area Ay: is the area swept within that region, or WL,. Thus 


the expressions: 
Whi WL, 
2, Aa " ®., As 


are defined by Koopman as the density of search effort in the two 





regions. Finally, the total searching effort will be defined as 
follows for the two-region case: 

G = A, ¢, +A, = W(b,+b2) = WL 
where G,; 0,20, and the total area is A=A,+ A: 


In summary, then, for the two-region search model, if: 


- @p 
e,< Vee [Equation 3'] 
then all searching effort should be confined to A,. Cie. Ly=L). 
Kf: -Z, 
Sh S & c [Equation 4°] 


then all effort should be concentrated in A,. Cie L FL). 


If however, 
~$Y, -B, 
& = ee and C masec 
[Equation 5] holds. So, by replacing x by Li, and by use of the 
preceding simpler and more meaningful definitions, the optimal 
distribution of search effort between the regions may be obtained as 


follows: AA ae 
LS ES 
nS a, (a, Lr nN Q -) 
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Substituting, 
A,Aa 
Ce wx (AL + Q. eioom 


AL aie me 
=A ( Qne, - Qe, ) 


Multiplying both sides by Te 


Whi . WL At | 
RT RT AT (eee, 
Noting that A,=A-A, and substituting, 


Pine tH LORY, ~ hes] 


Finally, 


B= Ye -(A, Me, +A, S.@,) ,& 


[Equation 5‘ ] 


and similariy, 


B= Be - (A Ke + A, ge )te 


Equations 3', 4’, and 5' are the results Koopman obtained in 


his study of a simple two-region searching situation, and those 


upon which most further work by Koopman and others in search theory 


is based. 
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IIT. AN n-REGION DISCRETE MODEL 


The two-region search model can be fairly readily extended to 

! 
a situation involving n regions. Some previous definitions can 
be modified as follows: 


A.. . .- area of the jth region 

L.. . . length of the observer's track in A.. 

Ps . . probability that the target is in A. 

Still assuming that the search is random, the probability of 


detection becomes: 
-Wli maT Or 


Pid) = > e: (\-e “ar ) -\-2 ee OS 


and the n-region problem may be stated as: 


maximize TO) = |- Te Pic 


~Wle 
L 


subject to: > i S18 
L, 2O for CabAls.-- 

This should be compared with the mathematica! statement of the 
two-region problem. 

By an argument analogous to that in the two-region case, it 
becomes obvious that either all the available searching effort (®) 
is divided up among all of the n regions, or there exists some sort 
of threshold value for each region below which no effort should be 
expended in that region. So, Kuhn-Tucker conditions are applied 
to the problem: 
~WLy 


vw 
° ° e me “AT 
minimize = Tce 
| 


subject to: Si heel 
i= 
Lae Bs GS ho ori 
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or, letting x. = L; as before: ae 


Y\ t 
minimize slew = 2 poe 
: subject to: z aie 
x SO eos L=ld,..-)" 

The technique for solving this problem by using the Kuhn-Tucker 
conditions is set forth in [13], and it is sufficient to the purpose 
of this paper that only a brief mention be made of the method. 

A solution to the minimization problem above is obtained by 


finding a saddle point of its Lagrangian, 


L (aa) = ye * - »(x- = x) 
In other words, by finding x* and A* such that, 
x 
Law) LG) < LG, 9) 
Necessary conditions for ti:. existence of such a point were 


found by Kuhn and Tucker to be: 


Ce ee Re Oo AO 
also, 
A ._ =z > 
Pls 
where - OA 
R=(a a ace ~) Ls =|; ) 
ob 
Ay 
and ou 
DA 
L- =] : 
Nhs 
orm 


For the problem at hand, with convex objective function and concave 


constraints, these conditions are also sufficient. 
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The solution of these conditions for the problem stated above 
gives the following results for the amount of effort to be expended 
| 


in any region, i. 


Letting J* = maximum P(D), there exists a dual variable 





o>" 
= ?>O 
a Ox such that: 
ve eee 
(a) if nt , then x. = 0 
. WP Bio Wei 
(b) if viet then xg = WO AR 


W pi 
Ai » Which equals We: , 


to be more consistent with prior notation, below which no effort is 


Note that Ais the threshold value of 


to be expended in region i. 
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IV. A CONTINUOUS MODEL 


It is a simple step from the n-region discrete model to a 
continuous one; n will be permitted to increase without bound, hence 
each A. approaches zero in the limit. Again, some modification of 


previous notation is necessary: 


it 


WLi 
og. = aa , Similar to the two-region search density. 


A; =Qxdy » since it represents a two-dimensional area. 

As a consequence of the breaking down of the notation into one- 
dimensional quantities, the subscripts which previously denoted areas 
are inconsistent and will be replaced by double subscripts, each 
representing a component in either the x or y dire: .ion «° the two- 
dimensional Cartesian coordinate system. Hence, each of the following 


identities is defined: 


Kt 


Piy = Pe 


%, = Di , as defined above, 
where the single subscript, denoting a region, is not to be confused 
with the first letter of the double subscript, denoting only the 
x direction. 


The continuous problem, then, is derived as follows: 


lin SZ aah (W-e ) ax dy 


Ax, By —>d { ) 


r jf peagy (1 =e 9") an dy 


~~ OF = 62 
where: p’x.y) is the joint probability density, and 


G(x,y) is the density of searching effort. 
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A mathematical statement of the continuous problem is: 


mgt TT ray Oe) any 


subject to: re D(x) Ovx ony = (0 
-—O-fr 
Gixy) FO Vay 
This problem was originally treated by Koopman in [5] as a 
problem in calculus of variations. Since 1946, however, new 
mathematical methods have evolved which can be used in this case. 
In a report by J. Taylor [11], Koopman's problem is solved by the 
Pontriagin Maximum Principle. 
Consider, for clarity, the one-dimensional continuous problem: 
oO 
maximize: j pix) (eeu) Ove 
DP (x) —co 
subject to: J Bix) ax = & 
~oO 
B(x) =O Wx 


Note that the two-dimensic’.. i problem which has been considered 
up to this point, may be treated in the same manner, though the 
details become complicated, so nothing is lost in considering the 
latter. 

In order to derive a solution to the above problem by the 
maximum principle, an equivalent problem must be formulated. Defining 
a new state variable, y(x), equal to the cumulative search effort 


expended for X <x: 
m% 


gi = | ere 
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the problem becomes: 


(\ = saa Ox 


pm 
AY = 
cela 


vO 
maximize 
Dix) = 


Subject to: 
where @(x) 20, 
and y(x= -»)=0, y(x= to)= @ 
The solution is, briefly, as follows: 


the Hamiltonian is: a 
H (a, yiad ,A@ BAY) = p (x) (\-e y+ AZ) 


and J* is defined as in the n-dimensional case: 
va — Zin) 
y*= MAA MUW f POO (\-e ) dn 
Pr) —~v >5" 
Thus the dual variable AO) = sums ©, since y(x) is the cumulative 
search effort, and since by expending more than the optimum effort, 


the maximum P(D) can only be decreased. Note that a(x) is a constant 


< Ax _ iz ov = 0 


The provlem now becomes: 
maximize Hx, a A ) 2) 
BCA) 
subject to: A(x) =O 
which is simplified by letting a= -u where u>0. 
By applying the necessary and sufficient conditions: 


(a) @(x)=0 when oe <0 


on _ — PCr) 
(b) @(x)>0 determined by Go ~ YES ~ = 
oH — BEr) 


uf es Site (SIS Vxje. 


The optimal distribution of searching effort is found to be 
dependent upon a threshold value of p(x) called u>0 such that: 

(1) for p(x)<u, @(x)=0 

(2) for p(x) >u, G@(x)= Jira UL = 


2] 








where u is determined as follows: 


| Defining = { x | ptr = v} , u is chosen such that: 
oo 
| e i 
I an (EE) on dn = \ gondx = ? 
$2 rsa 


The three basic models for the allocation of searching effort 
have now been described in some detail. The two-dimensional discrete 
and the continuous models were originally formulated by Koopman 
in 1946, while the n-dimensional discrete case simply provides an 
easy passage between the two. As stated previously, numerous 
extensions of Koopman's basic models have been derived since his 
Original paper, and brief descriptions of some of the more important 


of these will occupy the remainder of this thesis. 
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V. SOME EXTENSIONS TO THE BASIC THEORY 


A.; CHARNES AND COOPER, 1958 

| Charnes and Cooper state the objective of showing that search 
theory and mathematical programming can be combined to treat 
broader classes of operations research problems. 

Koopman's discrete allocation problem is treated as a problem 
in convex programming, the solution of which is obtained by 
application of the Kuhn-Tucker conditions, and a note is made on 
the extension of this method to the continuous case. 

The Charnes and Cooper model is an important contribution to 


Search theory in that the algorithm is solvable by computer. 


B. DE GUENIN, 1961 

De Guenin generalized the Koop ian risdels by developing an 
algorithm in which no assumption is mace regarding the detection 
probability function since, as he points out, while the assumption 
of the negative exponential (random search) function is adequaxe for 
military search problems, there are numerous non-military applica- 
tions of search theory,such as mine prospecting or 011 exploration, 
where this is invalid. 

De Guenin, then, expresses the probability of detection as a 
function of the density of search effort, that is el Pix) ] » and the 


generalized problem becomes: 


Po) 
— P= . 4 Ox) elem J an = P(g) 


CoO 
subject to: | Bini dx = @ 
— 2 


Biayro WA 
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where: P is defined to be the overall probability of success of the 
search, and g(x) is to be identified with p(x) in Koopman's continuous 
nadedi Necessary conditions for the optimal distribution of searching 
effort are developed by a finite difference approach, although today 
the problem may be solved by a routine application of the Pontriagin 


Maximum Principle [11]. 


C. DOBBIE, 1963 

Dobbie developed sufficient conditions for the additive property 
of the optimal distribution of search effort noted by Koopman in 1946. 
That is, the property that the distribution of effort, call it *(x), 
which maximizes the detection probability with a given amount of 
effort, ® » is in fact the sum of the optimal distribution of some 
part of the effort, Ey: and of the conditionally optimal distribution 
of the remaining effort, EA. given that the -arget has not been 
found with Ey: The author then derives the optimal distribution 
working fron this property, which is, in fact, nothing more than the 


Principle of Optimality from Dynamic Programming. 


D. POLLOCK, 1964 

Pollock presents a Bayesian approach to the problem of allocating 
search effort. Decisions are made in a sequential manner, depending on 
what has been observed up until that time. He has determined the 
optimal sequential strategies for a two-region discrete model. In 
Koopman's original resort, [5], it is interesting to note that he had 
shwon nothing was to be gained by such an approach since, in the two- 
region search, if additional effort, g 7 is added to $ after the 
search has failed to detect the target, and if this > is distributed 
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optimally between A, and Ay» the total effort applied to the two 
regions is B, v 8 and B., + 05. respectively, which by use of 
[Equation 5'] reduce to precisely the same values they would have been 
had the original effort been p+ §' with no prior knowledge of 


search results. 
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VI. CONCLUSIONS 


| The purpose of this thesis has been to bring together under a 
single cover the classic models for determining the optimal allocation 
of searching effort, and to give a very brief description of several 
of the more important recent developments in search theory. An 
excellent listing of further published works dealing with the 


allocation of searching effort can be found in reference [3]. 
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